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<^ ; ABSTRACT 

l We propose a method to restore and to segment simultaneously images degraded by a known point spread function (PSF) and 

. additive white noise. For this purpose, we propose a joint Bayesian estimation framework, where a family of non-homogeneous 
Gauss-Markov fields with Potts region labels models are chosen to serve as priors for images. Since neither the joint maximum 

I— i' a posteriori estimator nor posterior mean one are tractable, the joint posterior law of the image, its segmentation and all the 

Ph , hyper-parameters, is approximated by a separable probability laws using the Variational Bayes technique. This yields a known 

^ ■ probability laws of the posterior with mutually dependent shaping parameter, which aims to enhance the convergence speed of 

' the estimator compared to stochastic sampling based estimator The main work is description is given in [T], while technical 

' details of the variational calculations are presented in the current paper 

■ 

O 

■ 1. INTRODUCTION 

^ A simple direct model of image restoration problem is 



Oh: 



Index Terms — Image Restoration, Image Segmentation, Bayes procedures. Variational Bayes Approximation. 



g = Hf + e (1) 



^ , where g is the observed image. His a huge matrix whose elements are determined by a known point spread function, / is the 

■ unknown image, and e is the measurement error. 
\^ ' In a Bayesian framework for such an inverse problem, one starts by writing the expression of the posterior law: 

o ; 

^\ [ where p{g\f,6^;Ai) = Af{Hf,6f ^I), called the likelihood, is obtained using the forward model ([TJ and the assigned 

. probability law Pe(e) of the errors, p(/|02; -M) is the assigned prior law for the unknown image / and 

>: r 

; Pi9\0; M)= J p{g\f, e,;M) p(/|02; X) df. (3) 

5t ! is the evidence of the model Ai with hyperparameters 9 = {9^,02)- 



2. PROPOSED PRIOR MODELS 



As we introduced in the previous section, the main assumption here is the piecewise homogeneity of the restored image. This 
model corresponds to a great number of applications where the studied image is composed of finite number of materials. We 
consider two prior models for the unknown image: mixture of independent Gaussians (MIG) and Mixture of Gauss-Markov 
(MGM). 

Case 1: Mixture of Independent Gaussians (MIG): 

( pif{r)\z{r)^k) = Af{mk,vk), Vr G TZ 

with m,z{r) — nik^Vr G TZk, Vz{r) — Vk,yr G TZk, and 



Case 2: Mixture of Gauss-Markovs(MGM): 

p{f(r)\z{r) = k, /(r'), z{r'), r' e V(r)) = A^(/.fc(r), v^ir)) (5) 

with 

C{r) = l-n.'gv(.)'5(^(^')-2W) 

, , { rnk if C(r) = 1 

'''^"^ = I M^Ewev(.)/(-') if C{r) = (6) 
t'fe (t-) = f fe Vr g 7^fc 

For the hidden field z, a Potts Markov model will be used to describe the hidden field prior law for both image models: 

where ^{z{r)) is the energy of singleton cliques, and 7 is Potts constant. The hyperparameters of the model are class means 
TOfc, variances Vk, and finally singleton clique energy Kk ~ $(fc). 

For the hyperparameters 6 = {6^, m, v, k}, we choose the following prior laws: inverse Gamma for the model of the error 
variance 6^, Gaussian for the means m^. Inverse Gamma for variances Vk, and finally a Dirichlet for Kk- 

p{e,\ao,M = 5(«o,/3o), Vfc (8) 

p{mk\mo,ao) = 7V(too, ctq), Vfc (9) 

p{v^^\ao,bQ) = g{ao,bo), \/k (10) 

p{k\ko) = V{ko,--- ,ko) (11) 

where ao,Po, nio, ctq, oo, and kq are fixed for a given problem. 



3. VARIATIONAL BAYES APPROXIMATION 

In Bayesian framework, the joint estimation of the image /, the segmentation z, and the hyperparameter can be done from 
the joint posterior, 

p{f,z,0\g-M) « p{g\f,e,-M)p{f\z,m,v-M)p{z\K,r,M)p{e\M) (12) 

One of the main difficulties to obtain an analytical estimator is the posterior dependence between the searched parameters. For 
this reason, we propose, in this kind of methods, a separable form of the joint posterior law q, and then we try to find the closest 
posterior to the original posterior under this constraint in terms of the Kullback-Leibler divergence: 



KL(g:p) = ( q{x)\n- 
J P 



d. 



{x\M) (13) 
= -E,^fe)-anp(^l-M)),(.) 

So, the main mathematical problem to study is finding q{x) which minimizes KL(g : p). Using property of the exponential 
family, this functional optimization problem can be solved and we obtain: 



Iji^j) = TV cxP - {\np{x\M)) 



1-3 



(14) 



where q-j = Wi^j qi{xi) and Cj are the normalizing factors. Choosing a strongly separated posterior, where only dependence 
between image pixels and hidden fields is conserved: 



qif, z, 0)^11 [q{fir)\z{r))] n ki^r))] q{e,) 

r r I 



(15) 



and applying this approximated expression forp(/, 2, 6\g] M), we obtain: 





- n n mk{r),ik{r)) 


(16) 




k r^TZk 






= []p(z(r)|z(r'),r'e V(r)) 

r 


(17) 


q(z(r)=k\z(r')) 


= Cfe(r) oc Cfc dk{r) efc(r) 


(18) 


q{e,\a,p) 




(19) 


q{mk\ifik,ak) 


= A/'(mfc,o-fc), Vfc 


(20) 


qiVk^\ak,bk) 


= 0(afc,&fe), Vfc 


(21) 


<?(«) 


= • ■ • , Kif) 


(22) 



where tilded values need to be estimated in an iterative way since they are mutually dependent. We give in the following the 
expression of these values in the iteration t as function other values in the iteration t — 1. 

We start by /i^ and vl 



Cl{r) 
-t-i 



= f-\r)+ii{r) 



MIG case 



Er'evir) f^iir') + C* (r)m^, MGM case 



\V(r)\ Z^r'eV(r) ^ 

1 MIG case 

l-n.'ev(r.)a(r-'), MGM case 



fir) 

~g\s) = [nf]is)=J2His,r)f\r). 



(23) 

(24) 
(25) 

(26) 

(27) 
(28) 
(29) 

(30) 



While c^, (fj. and are given as 



4 



el(r) 



exp 



({;*(r))-i exp 



{i*(r) 



exp 



(31) 



(32) 



(33) 



Finally, the rest of the shaping parameters are 



a* 



/3* 



with 



(^g{s)-Y,His,r)f{r) 



and 



ifir)-Mr)y 



bo 



2 ' 
mo _^ 
CTo K 



i r 

o-^ + ^E ((/(-) 



Ecr^(-)- 



g2(s)-2g(^)5(^) + (.9(s)f 



E^'(«'^) 



E^^-(^)((^fc)'(^)+^'^(^))-/'M 



a(r) 



(/ifc(r))^ + w/c(r) - 2jlk{r)jll{r) 



|V(r)| 



+ Cfe(r) 



(TOfe)" + (7fc 



(34) 

(35) 
(36) 

(37) 

(38) 

(39) 
(40) 



(41) 



(42) 



4. CONCLUSION 

A variational Bayes approximation is proposed in this paper for image restoration. We have introduced a hidden variable to 
give a more accurate prior model of the unknown image. Two priors, independent Gaussian and Gauss-Markov models were 
studied with Potts prior on the hidden field. Technical Details of this approximation were presented . 
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